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DESIGN OF EXPERIMENTS AS "MULTIPLY TELESCOPING" SEQUENCES OF 
BLOCKS WITH APPLICATION TO CORROSION BY LIQUID METALS 

by Arthur G. Holms 
Lewis Research Center 

SUMMARY 

A blocked two-level factorial experiment was designed to measure the elevated- 
temperature time -dependent corrosion effects of liquid metals on immersed structural 
materials. Several types of block effects were postulated. The experiment was de- 
signed to be ’’multiply telescoping” so that orthogonal estimates of important param- 
eters could be obtained in the presence of two or more types of block effects, even if 
the numbers of blocks introducing the several effects were not specified in advance. 

The rationale is given for the selection of contrast and treatment generators to 
provide the options of multiple telescoping. The rationale is also given for identifying 
parameters aliased together and confounded with blocks, first, if some of the intended 
options are actually performed and, second, if blocks other than the intended options 
are actually performed. 


INTRODUCTION 

Davies and Hay (ref. 5) have noted that experiments could be designed as sequences 
of orthogonal blocks of two- level fractional-factorial experiments such that observations 
either from the first block or from a small number of blocks could be used to estimate 
the coefficients of a simple model. Then, at the option of the experimenter, new blocks 
of the sequence could be performed such that all acquired observations would be used 
cumulatively to estimate models of successively greater generality; and the coefficient 
estimators would be orthogonal to the block effects. General rules for doing this were 
given by Daniel (ref. 3). A large catalog of the defining contrasts for appropriate plans 
together with an evaluation of their properties was provided by Addelman (ref. 1). The 
name "telescoping” has been applied to similar plans in a smaller catalog that also 
listed the treatments and the aliased parameters (ref. 7). 



The foregoing papers assumed that the block effects were the result of a single 
influence such as an influence correlated with time. The concept of designing for two 
independent block effects (double confounding) was developed by Holms and Sidik (ref. 8). 
In that report, rules were given for identifying parameters aliased together and for 
identifying parameters confounded with block effects in terms of some given group of 
defining contrasts. Designing for telescoping when more than two independent block 
effect sources are present is the subject of the present report. Two important aspects 
of the subject are treated. One is the problem of actually generating appropriate groups 
of defining contrasts. The other is the problem of identifying parameters aliased to- 
gether and confounded with block effects, if the blocks actually performed are not those 
originally contemplated for the telescoping options. 

This report discusses multiple telescoping in detail. The discussion will be illus- 
trated by the design of an experiment to observe the elevated temperature corrosion 
effect of liquid metals on the immersed structural material. Rules are developed for 
identifying parameters aliased together and for identifying parameters confounded with 
block effects, if the blocks actually performed differ from the design options. 


SYMBOLS 


a, b, . . . 

a,b, . . . 
C(i, j,k, l) 
c 

g 

h 


I 

j»k, l- 

X A> X B’ ' ' ' 
Y 


y 




B’ 


e 


defining contrasts 

treatment has x^, Xg, ... at its high level 

set of defining contrasts 

number of column blocks 

number of independent variables (factors) 

h 

one block contains (1/2 ) n of the treatments of a full two-level factorial 
experiment 

identity contrast 

levels of block effects of type i, j,k, l ■ 

independent variables 

random response variable 

observed value of Y 

treatment parameters 

single observation random error 
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I tip Mj, . . . block effect parameters 

(1) treatment with all independent variables at their low level 

STRUCTURE OF MULTIPLE TELESCOPING 
Treatment Parameters 

In brief, the purpose of a two-level fractional-factorial experiment is to estimate 
the coefficients of an equation. The equation together with assumptions about the ex- 
perimental error are called the model . The factorial experiment provides estimates of 
the treatment parameters (coefficients) of an equation of the form 

Y = p 1 + /3 a x a + /3 b x b + . . . + /3 g x g + /3 ab x a x b + P AC x AC + ... + ^g-1, g x gl x g 

+ £ABC X A X B X C + • • • + Pg-2, g-1, g x g-2 x g-l x g + • • • + e 

where x A , . . . x g are the independent variables, e is the random error , and the j8 are 
the treatment parameters. 


Notation for Treatments and Defining Contrasts 

The independent variables can be standardized (transformed) so that the upper level 
is represented by x A = +1, x B = +1, and so forth, and the lower level by x A = -1, 
x B = -1, and so forth. A combination of levels of the independent variables is called a 
treatment . The notation for the treatments is illustrated by the elements of the rows of 
table 1(a) that are under single letter column headings. The first column of table 1(a) 
gives the familiar notation for treatments described by Davies (ref. 4). The third 
column of table 1(a) and columns to the right give the linear combinations of the obser- 
vations, which, on division by the number of items in the column, estimate treatment 
parameters of equation (1) that are subscripted to match the column headings. 

The arrangement of table 1(a) illustrates the assumption that all of the treatments 
were performed in a single block. An arrangement illustrating a performance of the 
same treatments in four blocks is given in table 1(b). The resulting confounding of 
treatment parameters with block effect parameters is illustrated in table n, which will 
be discussed in the section Illustrative Example with Four Independent Variables. 
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Additional discussion of notation and terminology was given by Davies (ref. 4) and by 
Holms and Sidik (ref. 8). 


Crossed Classification of Block Effects 

Two assumptions are fundamental to planning an experiment for multiple telescoping. 
One is that the block effects may be classed as crossed. With crossed block effects, 
each type of block effect can be identified separately from every other type of block 
effect. Interactions among the block effects can then be defined and estimated. The 
other assumption is that no block variables interact with treatment variables. If they 
did, then such block variables would be handled as treatment variables. Such handling 
would increase the number of parameters to be estimated but would require no basic 
change in the theory, because crossed classification is assumed for both block and 
treatment variables. 


Maximum Number of Types of Block Effects 

The construction of a plan for multiple telescoping begins with a principal block 
that is a 1/2^ replicate of the full 2^ experiment. As such, it contains 2^”^ treat- 
ment combinations and becomes a full 2^ factorial experiment if expanded by doubling 
h times. Every such doubling could be accompanied by a new type of block effect, so 
that as many as h types of block effects can be postulated. The number of independent 
defining contrasts for the 2^”^ replicate is h, so that the maximum number of block 
effect types is equal to the number of g enerator s of the smallest principal block . 

Defining Contrasts 

The properties of experiments consisting of the contemplated stopping points of 
telescoping sequences are mainly determined by the distribution of the word lengths of 
the defining contrasts of the smallest fraction of the experiment. (Construction of the 
experiment is simplified by making the smallest fraction a principal block. ) Addelman 
(ref. 1) has tabulated some of the properties that can be achieved. The sequence of 
expansions he tabulated for a particular family of defining contrasts could constitute one 
possible path through the many options of multiple telescoping. The other possible paths 
opened up by the concepts of multiple telescoping deserve investigation. 
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In many cases, the defining contrasts tabulated by Addelman could serve the pur- 
poses of multiple telescoping. In other cases (such as the present corrosion experi- 
ment) the smallest block will be smaller than the smallest block tabulated by Addelman, 
and a larger number of contrast generators will be needed. 


Block Parameters 


Block effects from sources i, j,k, . . . can be represented by first degree param- 
eters Pp jUj, jUjp . . . and by block interaction parameters . . . , M^, • • • Half 

replicates of the experiment can then be defined that would not introduce the i-source 
block effects, or would not introduce the j-source block effects, or would not introduce 
some other source of block effects. That is to say, if the half replicate were not per- 
formed that would, for example, introduce the j-source block effects, then the param- 
eters ju., jii.,, (i.-. and all other block parameters having a subscript j would be zero. 

J -U 

A particular defining contrast of a half replicate can then be associated with such a 
particular source of block effects. 


GENERATION OF DEFINING CONTRASTS 
Corrosion Experiment 

The experiment requires the observation of the elevated temperature corrosion 
effect of a liquid metal on specimen materials. Four specimens can be installed in a 
furnace, and four furnaces can be installed in a vacuum chamber. The experimenter 
wanted the option of using one or two vacuum chambers. Because just four specimens 
can be loaded into a furnace, the basic block size consists of four treatments per block. 

The effects of six independent variables are to be observed. The independent vari- 
ables are time, temperature, oxygen in T-lll structural material, nitrogen in T-lll 
structural material, presence of TZM in system, and presence of W-25Re in system. 
The assignment of particular treatments to particular blocks will be discussed in the 
section DETERMINATION OF TREATMENT GENERATORS. The treatments are 
assumed to be assigned at random to experimental units within the blocks. 

In addition to showing the assignment of particular treatments to particular blocks, 
the general arrangement of the experiment is shown by table HE. The furnaces are 
identified by the paired numbers (i, j) and these furnace identifications are the row block 
headings. 
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The two vacuum chambers are represented by l - 1 and 1=2. Two successive 
loadings of each chamber are represented by k = 1 and k = 2. If only one vacuum 
chamber were used for all four loadings, then the loadings would be identified by col- 
umn headings consisting of the paired numbers (k, l). A basic assumption of the present 
discussion of multiple telescoping is that both the treatment effects and the block effects 
are crossed classification effects. If two vacuum chambers were used and identified 
by l = 1 and 1=2, and if a different set of furnaces were used in the second vacuum 
chamber, the assumption of crossed block effects would be violated. The furnaces 
would be nested within vacuum chambers both in the physical sense and also in statisti- 
cal jargon. The design and analysis of multiply telescoping experiments in the case of 
a nested classification has not been investigated. 

The planned experiment has three independent sources of block effects, namely, 

(1) differences among the four furnaces, (2) differences between the two vacuum cham- 
bers, and (3) differences between the first and the second loading of a vacuum chamber. 
Because the full replicate consists of four doublings from the smallest block, four in- 
dependent sources of block effects could have been tolerated (as represented by the four 
symbols i, j, k, and l). 


Defining Contrasts for the Principal Block 

A single block of the corrosion experiment can be thought of as a 2^"^ experiment 
where 2^”^ = 4. Then with six independent variables, g = 6 and h must be 4; that is, 
the number of contrast generators for the smallest fractional replicate is 4. 

One way of beginning the synthesis of the four needed generators is to use the 
letters A, B, C, and D singly as generators. The complete group of defining con- 
trasts is then obtained by multiplying these letters together in all possible combinations 
as shown by table IV. If only the letters A, B, C, and D were used, then the vari- 
ables Xg and Xp would be omitted from the experiment. These variables are included 
by attaching combinations of E and F to the generators A, B, C, and D. 

An unfortunate constraint on the experiment is that the specimen temperature can- 
not be varied from specimen to specimen within a furnace. If the temperature is x^, 
then x^ is a constant within the block represented by a furnace. Thus, the main effect 
of x^ must always be confounded with some kind of a block effect, and therefore the 
single letter A must appear among the defining contrasts of table IV. 

In some experimental arrangements, the time that a specimen is exposed to furnace 
temperature in a vacuum chamber might not be variable from specimen to specimen, in 
which case some independent variable representing time, say Xg, would also be con- 
stant within furnace blocks. Then the single letter B would appear among the defining 
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contrasts of the single block. For the equipment under consideration, specimens can 
be withdrawn from furnaces without destroying the vacuum, so that the heating time can 
be varied within furnace blocks. 

Thus the letters E and F cannot be suffixed to the letter A of table IV, but 
these letters can be added to the letters B, C, and D as was done in table IV. The 
letters E and F then participate in the same multiplication combinations as the A, 

B, C, and D as shown in table IV. The manner in which the E and F are added to 
the B, C, and D is arbitrary, except that the distribution of the word lengths might be 
a consideration. In general, short words are undesirable because they confound low- 
order treatment parameters with block effects, or else they give poor resolution levels 
to the fractional replicates. 

Experimenters sometimes want the first block to contain a set of control or refer- 
ence conditions which is assumed to be the treatment combination for which all variables 
are at their naturally or artificially defined low levels. The block containing such a 
treatment is called the principal block . The construction of a telescoping sequence is 
then made particularly convenient if each expansion consists of doubling from the prin- 
cipal block; then the expansions can be achieved by the use of treatment generators that 
satisfy the rule of even numbers, and the defining contrasts of an expanded stage will be 
a subgroup of the defining contrasts of the preceding stage. Thus, all stages will con- 
sist of p rincipal fractions . So that they will define a principal block, the defining con- 
trasts (table IV) containing an odd number of letters must be given a negative sign. 


Defining Contrasts for Additional Blocks and for Block Effects 

The experiment beginning with the block of size four can be expanded in a sequence 
of stages with the important treatment parameter estimates orthogonal to block param- 
eter estimates provided the sequence consists of doublings. With each of the doublings, 
the defining contrasts will be a subgroup of the defining contrasts before the doubling, 
and with each of the doublings, an independent source of block effects is assumed to be 
introduced. Assuming that there are the maximum number of block effect sources (the 
full replicate consists of four doublings of the principal block) let the sources be repre- 
sented by the discrete variables i, j, k, l, where the variable takes the value 1 if the 
doubling has not occurred (block effect has not been introduced) and takes the value 2 if 
the doubling has occurred (block effect has been introduced). The block effect levels 
can then be represented by the borderline values of i, j, k, and l of table HI. 

The subgroups of defining contrasts that will represent successive doublings of the 
experiment are to be chosen from the 16 defining contrasts of the first block (table IV). 
Of the possible doublings, the most important is the defining contrast representing 


7 



1 

doubling with respect to vacuum chamber loadings. This is because the experimenter 
has said that the probability is high that he will stop the experiment exactly at the half 
replicate consisting of the four furnaces operated for just two loadings of one vacuum 
chamber. That replicate is defined by l = 1 in table HI. So that such an experiment 
will have the highest possible resolution level (ref. 2), the longest length- defining con- 
trast of table IV (-ABCDE) should define it. 

Because there is a small but positive probability of stopping with k = 1 and 1=1, 
the contrast defining doubling with respect to k should also be a longer word of table IV. 
(ABEF was so chosen and its product with -ABCDE, namely, -CDF, should also be a 
longer word of table IV. ) 

The experimenter’s prior probabilities of some of the block effects were relatively 
high - 50 percent for a direct effect of differences among furnaces and 20 percent for 
a difference between vacuum chambers. On the other hand, the experimenter’s prior 
probabilities for stopping at fractional replicates not already discussed were extremely 
low, so that the matching of other defining contrasts of table IV to the block sources 
should not be done anticipating such stopping points, but, instead, should be done 
according to the experimenter's prior probabilities of block effects. The relatively 
high prior probabilities of furnace block effects suggest that the treatment parameters 
that must be confounded with the furnace block effects should be treatment parameters 
presumed to have small prior probabilities of being nonnegligible, namely, the higher 
order interactions. Thus, the defining contrasts that define expansions of the experi- 
ment with respect to i, j, and ij should be some of the longer words of table IV. The 
words chosen for i and j in table IV must be words such that their product (repre- 
senting furnace block effect ij) will also be a longer word. The words chosen were 
-ABC, -BDF, and ACDF. 

The four independent defining contrasts just chosen to represent doublings with re- 
spect to i, j, k, and l are so identified in table IV. Each such contrast by itself is a 
defining contrast for a half replicate experiment. Any two of these contrasts provide 
the generators of a quarter replicate experiment. Thus, many different regular frac- 
tions of the experiment from a half replicate on down to a one-eighth replicate may be 
generated by using combinations of these four generators. In such cases, the defining 
contrasts so generated will be subgroups of the group generated by all four half repli- 
cate generators (as listed for the 1/16 replicate by table IV). 
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DETERMINATION OF TREATMENT GENERATORS 
Rule of Even Numbers 

Treatment generators are selected by the rule of even numbers (ref. 4). The 
selection was made from the display of table V. It lists all the treatments of the full 
factorial experiment as row headings, and, as column headings, it lists the independent 
defining contrasts of the half replicate experiments first selected for that purpose in 
table IV. Also listed in table V are the numbers of letters that occur in common be- 
tween the treatments and the defining contrasts. According to the rule of even numbers, 
the treatment generators of the principal block must have only even numbers in common 
with all of the defining contrast generators. Scanning table V shows that the first two 
treatments meeting these conditions are the first two treatment generators listed in 
table VI. Any given treatment generator that doubles the size of the experiment must 
have an even number of letters in common with all the defining contrast generators, 
except for the defining contrast generator that disappears on doubling the experiment 
with the given treatment generator. The first four such treatment generators of table V 
are indicated by the occurrences of three even numbers underlined together with one 
odd number not underlined. 


Detailed Plan of Experiment 

The associations between such treatment generators and the contrast generator 
they eliminate by the doubling are shown in table VI. The use of the same treatment 
generators to generate the detailed plan of the experiment is shown by table HI. 


IDENTIFICATION OF CONFOUNDED PARAMETERS 
Illustrative Example with Four Independent Variables 

Identification of the treatment parameters that are confounded with block parameters 
remains to be discussed. The basic method will be developed through a discussion of 
a hypothetical experiment on four independent variables. (The corrosion experiment 
with six independent variables will be discussed in the next section. ) For the hypotheti- 
cal experiment on four independent variables, the treatment levels of the full factorial 
experiment performed as a single block are shown by table 1(a). The full factorial 
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experiment of table 1(a) was assumed to be subdivided for double telescoping as shown 
by table 1(b). 

The groups of defining contrasts for the contemplated replicates will be represented 
by the symbol C(i, j) where the discrete variable i gives the number of row blocks 
in the replicate, and the discrete variable j gives the number of column blocks in the 
replicate. As discussed by Davies (ref. 4) in the chapter on fractional-factorial exper- 
iments, the column contrasts of table 1(b) that have uniform algebraic signs over the 
replicates identify the defining contrasts for some of the possible fractional replicates 
as follows: 

C(l, 1)=I, -ABC, -ABD, CD 
C(l, 2) = I, -ABD 
C(2, 1) = I, -ABC 
C(2, 2) = I 


The interrelations of the preceding lists of defining contrasts with possible block 
parameters will be established by comparing the defining contrasts of table 1(b) with 
postulated block parameters. The postulated block parameters are listed in the first 
column of table n, namely, (1) a grand mean / u Q , (2) an effect resulting from doubling 
over rows p^, (3) an effect from doubling over columns Pj, and (4) a row column block 
interaction effect py. 

In the case of just the principal block (i = 1 and j = 1), table 1(b) shows that the 
contrasts I, -ABC, -ABD, and CD all have the same sign and thus the estimator of 
the grand mean for this block also estimates a linear combination of treatment param- 
eters with these contrasts as subscripts. The treatment parameters are all aliased 
together and confounded with the grand mean as indicated under C(l, 1) of table II. 

If the experiment is now doubled by adding the block for which j = 2, then the con- 
trast under ABD (table 1(b)) is of uniform sign so that jS^BD is confounded with the 
grand mean /3j, as represented by row p Q and column C(l, 2) of table II. Further- 
more, the contrast ABC has opposite signs for the two blocks, so that the estimate of 
the parameter /3^BC is also an estimate of the difference between the blocks. The 
same statement can be made with respect to the CD contrast of table 1(b) so that, as 


represented in table II, Pqy) and are both confounded with 


Similar statements can be made about the aliased and confounded parameters re- 


sulting from the C(2, 1) replicate. 


10 



In the case of the full replicate, the column under I of table 1(b) provides the esti- 
mate of the grand mean, and that parameter can be called /3j or p Q . The contrast 
under ABD has a change of sign from i = 1 to i = 2 and thus provides an estimate of 
the treatment parameter /3 ABB confounded with the block parameter jlu . The contrast 
under ABC changes sign when j changes from j = 1 to j = 2 and thus provides an 
estimate of the confounded combination of /ij and j3 A g£- The contrast under CD 
has positive signs for both 1 = 1, j = 1 and i = 2, j =2, but it has negative signs for 
both i = 1, j = 2 and i = 2, j = 1. Thus, the contrast CD estimates the treatment 
parameter confounded with the block interaction parameter /i- . In summary, 

the first two columns of table II show which of the defining contrasts of the smallest 
fractional replicate become estimators of the postulated block effects in the full repli- 
cate. 

Table n also shows how the treatment parameters confounded with block parameters 
can be quickly identified for all the contemplated fractional replicates. The defining 
contrasts for the contemplated fractional replicates are given by the subscripts of the 
treatment parameters aliased with q 0 (listed in the n Q row of table n). Then, for a 
block effect that can exist, the defining contrast of the full replicate for that block 
parame ter (in the s econd column of table II) multiplies the defining contrasts of the par- 
ticular fractional replicate (subscripts in the ii Q row) to give the subscripts of the 

treatment parameters confounded with the particular block parameter . For example, the 
C(l,2) replicate has defining contrasts I and -ABD as shown by the subscripts of the 
treatment parameters in the fj. Q row. Doubling the C(l, 1) replicate to the C(l, 2) 
replicate is done with respect to the j source of block effects so that the /Xj parameter 
is postulated. In the full replicate (as shown by the second column of table n), the 
parameter has defining contrast -ABC. The products of -ABC with the defining con- 
trasts of the C(l, 2) replicate (namely, I and -ABD) are -ABC and CD, and thus the 
treatment parameters confounded with jitj are as listed under C(l,2) of table II, 
namely, -/3 ABC + 0 CD . 

Identification of Confounded Parameters in the Corrosion Experiment 

Identification of the estimators confounded with block effects is to be done by 
identifying the treatment parameters that are confounded with block parameters. This 
is to be done through the groups of defining contrasts in the manner just described for 
the illustrative example with four independent variables. As a start, block parameters 
are postulated to represent the physical plan of the experiment. 
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Individual furnaces might degrade with time, either gradually or suddenly. There- 
fore, all conceivable interaction effects might exist between the furnace blocks and the 
time blocks. Thus besides the furnace effects, p., Mj, and the time effects, M k , 
the furnace time interactions, M*, M u , M jk , M jz , M ijk , M ijr M jkz , 

^ijkZ are P os t u l a ted. 

A notation is needed for the groups of defining contrasts that define the contemplated 
stopping points. The symbol C(i, j,k, l) will represent such groups for the contem- 
plated replicates. For any such fractional replicate, those variables among i, j, k, l 
that are identified with a generator of the given replicate will remain at their low level, 
whereas doubling with respect to a source of block effects will be represented by the 
presence of the variable at its high level. The association between the variables repre- 
senting sources of block effects and the generators of fractional replicate defining con- 
trasts was discussed in connection with table VI. 

The scheme for identifying the aliased combinations of model parameters that are 
confounded with block parameters is basically the same as that displayed for the hypo- 
thetical experiment on four independent variables by table n. 

The scheme for the corrosion experiment is displayed by table VII. The first 
column lists the block parameters and the second column gives the experimentor's 
prior probabilities that such block effects exist. The four defining contrasts shown in 
table VI for expansions with respect to i, j, k, and l are listed in the third column of 
table VII. These four defining contrasts are then multiplied together as required by the 
multiplications of i, j, k, and l in the first column. The resulting products are the 
contrasts that define the block effects that were listed in the first column. As would be 
expected, these contrasts also occur in the first column of table IV. 

The defining contrasts that estimate the block effects in the full replicate are given 
by the third column of table VII. These contrasts are also the subscripts of the treat- 
ment parameters estimated by the contrasts; therefore, such treatment parameters are 
confounded with the associated block parameters in the full replicate. 

The defining contrasts for the larger fractional replicates as generated from table VI 
are given in the fourth through 13th columns in the y- Q row of table VII. Under these 
replicates, the block effects of the full replicate must disappear according to the frac- 
tion of the full replicate that is not performed. For the fraction that is performed, the 
block effect contrast of the full replicate experiment multiplies the fractional replicate 
defining contrasts to give the subscripts of the treatment parameters that are aliased 
together and confounded with the block effect parameters (as listed in the columns of 
table VU). 

An alternative to the identification procedure illustrated by this discussion of 
table VU was given for double telescoping by Holms and Sidik (ref. 8). That procedure 
is equally applicable to multiple telescoping. 
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MISSING BLOCKS 
Contemplated Blocks 

Thus far, the blocks actually performed were assumed to be those that conform to 
the options designated by lower or upper levels of i, j, k, and l as in table HI. Such 
options are compatible with the defining contrasts given in tables IV and VII. The de- 
fining contrasts are assumed to have been selected to be optimal from some point of 
view, and these contrasts determine the structure of the confounding between the model 
parameters and the block parameters as illustrated in table VII. Remaining to be dis- 
cussed is the subject of the estimation of parameters when the blocks performed do not 
conform to any of the options implied by the C(i, j,k, l) notation of table VII. 

For example, if at any time during the experimenting, one or more of the furnaces 
were found to be defective, then such missing data would be equivalent to a limitation on 
the previously listed values of i and j. According to what particular furnaces were 
defective, the attribute of orthogonality could be achieved by suitably restricting the 
values of i or j or both. (Such a restriction might discard some data beyond the data 
that were missing.) 


Regression Methods 

In any case, the methods of regression analysis (Draper and Smith (ref. 6)) are 
available as a back stop analysis for an experiment that has not been completed accord- 
ing to plan. When it must be used, the success of such a salvage operation will depend 
(1) on what has been removed from the plan, (2) on how well the statistician knows the 
true conditions of the experiment, and (3) on how intelligently he matches the form of 
the regression equation to his knowledge of the true conditions of the experiment. 


Orthogonal Blocks 

The salvage operation of regression or more sophisticated analysis need not be 
used even if the blocks actually performed differ from those contemplated in the tele- 
scoping options, provided that the performed blocks constitute a regular fractional 
replicate. In such cases, an effort beyond that already described will be needed to con- 
struct the model that can be estimated. An example will be used to illustrate some 
techniques that are useful in matching the estimates to the aliased combinations of 
parameters. 
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Suppose that accidents to the equipment were such that the treatments performed 
are only those of furnace numbers 2 and 3 and vacuum chamber loadings 1 and 4. These 
treatments are shown in table HI by the following combinations of i, j, k, and l : 


i, j, k, l 

Treatments 

2, 1, 1, 1 

abed, ae, adf, abcef 

1, 2, 1, 1 

ab, aede, acf, abdef 

2, 1, 2, 2 

a, abede, abef, adef 

1, 2, 2, 2 

acd, abe, abdf, acef 


Identification of Defining Contrasts 

The problem of putting the treatments and their associated observations in standard 
order for the purpose of using Yates’ algorithm will be approached by ignoring certain 
treatment letters, somewhat in the manner of Daniel (ref. 3). The procedure is started 
by putting the treatments in what would be standard order for the full replicate . This 
has been done in table VIII. Furthermore, the 16 treatments would constitute a full 
factorial experiment if only four independent variables were present, and, therefore, 
two of the six variables actually present must be ignored. The ignored variables are 
enclosed in parentheses in table VTH. They were selected so that the letters not in 
parentheses would form a standard order pattern. The letters in standard order pattern 
are b, d, e, and f. 

Yates' method with a full factorial experiment on four independent variables Xg, 

X D’ X E’ anc * X F then provides estimates in the row-wise order of the treatment param- 
eters occurring in first position among the alias sets of table VTH. (For example, the 
first four estimates are estimates of /3j, /3g, /3g, and ^BD‘ ) 

The alias sets remain to be determined and this will be done in terms of defining 
contrasts. The defining contrasts are to be determined making particular use of the 
treatment letters that were enclosed in parentheses in table VIII. Inspection of the 
treatment column of table Vin shows that the letter a is present everywhere, thus the 
contrast A is equal to the contrast I; that is, 

A =1 

Furthermore, the letter c is present whenever there is an odd number of letters d or 
f, independently of e. Thus, x^, takes on its positive value whenever just one of x D 
or Xp takes on its positive value, the other being negative. Under this circumstance, 
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the governing relation is 


C = -DF 


or 


I = -CDF 

The complete group of defining contrasts is, therefore, 

[I, A, -CDF, -ACDF] 

The preceding group is now used to determine the last three of each of the alias 
sets of four treatment parameters of table VIII. This is done by multiplying the sub- 
scripts of the first members (which have already been determined) in the usual manner 
with the preceding group of defining contrasts. The results are listed in table VUI. 

Nelder (ref. 9) has also discussed the identification of aliased treatment parameter 
combinations with estimates from Yates' algorithm, when a fraction other than the prin- 
cipal fraction has been used for the fractional replicate. 


Identification of Block Parameters 

The confoundings among block parameters and treatment parameters remain to be 
identified. For this example of missing blocks, the contrast groups will be labeled by 
the symbol C(r, c), which is defined in table IX. 

For C(2, 1) the treatments may be written in the standard order as 


(a) 

(b) 

(c) 

(d) 

(a) 



e 

(a) 



(d) f 

(a) 

(b) 

(c) 

e f 


where the letters not in parentheses are in the standard order of a two-level full- 
factorial experiment. The letters in parentheses show that the high levels of these 
treatments are matched to the positive and negative values of x E and x F according to 
the rules 


15 



A =1 


B = EF 
C = EF 
D = -E 

and the defining contrast generators are, therefore, A, BEF, CEF, and -DE. The 
preceding list of generators permits construction of the complete group of defining con- 
trasts as listed for C(2, 1) in table EX. 

For expansion from r = 2 to r = 3 with c = 1, table ID shows that the treatment 
blocks are 


abed 

ae 

adf 

abcef 

ab 

aede 

acf 

abdef 

Arranged in standard order these treatments are 


(a) 

(b) 


(a) 

(b) 

(c) 

(a) 



(a) 


(c) 

(a) 


(c) 

(a) 



(a) 

(b) 

(c) 

(a) 

(b) 



The letters in a Yates' order pattern are the letters that are not in parentheses, and 

3 

they constitute the treatments of a full 2 experiment. The letters in parentheses are 
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seen to have their levels subject to the rules 


A = I 
B = EF 
C = -DF 

so that the defining contrast generators are A, BEF, -CDF. The complete group of 
defining contrasts is given in the C(3, 1) column of table IX. 

For the expansion from c = 1 to c = 4 with r = 2 the treatment blocks are 

abed 

ae 

adf 

abcef 

a 

abede 

abef 

adef 

Arranged in standard order these treatments are 

(a) 

(a) (b) (c) d 
(a) e 

(a) (b) (c) d e 
(a) (b) (c) f 
(a) d f 

(a) (b) (c) e f 

(a) d e f 
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The letters in parentheses are seen to have their levels subject to the rules 


A =1 


B = -DF 
C = -DF 

so that the defining contrast generators are A, -BDF, and -CDF. The complete group 
of defining contrasts is given in the C(2, 4) column of table IX. 

Identification of treatment parameters confounded with block effects can now be done 
according to rules given by Holms and Sidik (ref. 8). Thus, from the C(3, 4) column 
of table IX the treatment parameters confounded with the grand mean are 0p /3^, 

"^CDF’ and “^ACDF as listed in table VIII. The contrasts in C (2, 4) that are not in 
C(3, 4) identify the parameters of C(3, 4) confounded with the row doubling as 
-^BDF’ ^ABC’ an< * "^ABDF' These parameters are identified by the superscript r 
in table VIII. The contrasts in C(3, 1) that are not in C(3, 4) identify the parameters of 
C (3, 4) confounded with the column doubling as ^ABEF’ _jS BCDE’ ancl ~^ABCDE‘ 

These parameters are identified by the superscript c in table VIII. The contrasts in 
C(2, 1) that are not in C(3, 1) and not in C(2, 4) of table IX identify the model parameters 
confounded with row-column interaction block effects as ~ /^DE ’ ^ACEF’ anc * 

~^ADE' These parameters are identified by the superscript rc in table VUI. 


CONCLUDING REMARKS 

A blocked two- level factorial experiment was designed to measure the elevated- 
temperature time-dependent corrosion effects of a liquid metal on some immersed 
structural materials. Several types of block effects were postulated. The experiment 
was designed to be multiply telescoping so that orthogonal estimates of important treat- 
ment parameters could be obtained, even if the numbers of blocks introducing the sev- 
eral effects were not specified in advance. 

Subjects receiving particular attention were 

1. The construction of the complete group of defining contrasts 

2. The matching of particular defining contrasts to particular options of fractional 

replication 

3 . The matching of particular defining contrasts to particular block effects 

4. The selection of treatment generators to provide the options of multiple tele- 

scoping 
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5. The identification of aliased and confounded parameters 

6. The consequences resulting from failure to perform exactly those blocks speci- 

fied by the options 

Lewis Research Center, 

National Aeronautics and Space Administration, 

Cleveland, Ohio, May 25, 1971, 

129-03. 
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TABLE I. - 2 EXPERIMENT 


(a) Full replicate in. one block 


Treatment Response 


Matrix of independent variables 

I A B AB C AC BC ABC D AD BD ABD CD A CD BCD ABCD 

+1 -1 -1 +1 -1 +1 +1 -1 -1 +1 +1 -i + i _i +1 

+1 +1 -1 -1 -1 -1 +1 +1 -1 -1 +1 +1 +1 +i _ i - x 

+1 -1 +1 -1 -1 +1 -1 +1 -1 +1 -l +i + i +1 _ 1 

+1 +1 +1 +1 -1 -1 -1 -1 -1 -1 -i .1 + i +1 +1 


+1 -1 -1 +1 +1 -1 -1 +1 -1 +1 +1 .1 

+1 +1 -1 -1 +1 +1 -1 _1 _i - 1 +1 + i 

+1 “1 +1 -1 +1 -1 +1 -1 -1 +1 -1 +1 

1+1 +1 +1 +1 +1 +1 +1 +1 -1 -1 -1 -1 


-1 +1 

- 1 -1 

-1 +1 

-1 -1 


+1 -1 - 1+1 - 1+1 +1 -1 +1 - 1-1 +1 -1 +1 

+1 +1 -1 -1 -1 -1 +1 +1 +1 +l -1 _i _i 

+ 1 -1 +1 -1 -1 +1 -1 +1 +1 -1 + 1 -1 +1 

+1 +1 +1 +1 -1 -1 -1 -1 +1 +1 +1 +1 _1 

+ 1 -1 -1 +1 +1 -1 -1 +1 +1 -1 _1 + 1 _ 1 

+ 1 +1 -1 -1 +1 +1 -1 -1 +1 +1 _1 -1 + l + 1 

+ 1 -1 +1 -1 +1 -1 +1 wl +1 _1 +1 _1 + l _1 

+ 1 +1 +1 +1 +1 +1 +1 +1 4-1 +1 4-1 4-1 + l + 1 

(b) With double telescoping among four blocks 


w Column Treatment 


Matrix of independent variables 

I A B AB C AC I BC I ABC I D I AD I BD I ABD ( CD I ACD I BCD I ABCD 


+ 1 -1 -1 4 1 -1 4-1 4l 

+ 1 + 1 -1 -1 +1 4l -1 

+ 1 -1 4l -1 4 1 -1 4 1 

4l + 1 4l 4l -1 -1 -1 


- 1+1 +1 


-1 I 4 1 I 4 1 


+ 1-1 +1 


-1 +1 -1 -1 

-1 +1 +1 -1 

-1 +1 -1 +1 

-1 +1 +1 +1 


+ 1 +1 -1 -1 -1 -1 +1 4 1 +1 +1 -1 -1 -1 -1 +1 

+ 1 -1 -1 +1 +1 -1 -1 +1 -1 + 1 +1 -1 -1 4l +1 

+1 +1 +1 +1 +1 +1 +1 +1 -1 -1 -1 -1 -1 -1 -1 

+ 1 -1 +1 -1 -1 +1 -1 4-1 +1 -1 +1 -1 -1 + 1 -1 


+ 1 -1 -1 +1 -1 +1 +1 

+ 1 +1 -1 -1 +1 +1 -1 

+1 -1 +1 -1 +1 -1 + 1 

+ 1 +1 +1 +1 -1 -1 -1 


-1 +1 -1 -1 +1 -1 4 1 +1 

-1 -1 -1 +1 +1 -1 -1 4 1 

-1 -1 +1 -1 +1 -1 +1 -1 

-1 +1 +1 +1 +1 -1 -1 -1 


+ 1 +1 -1 -1 -1 -1 +1 +1 -1 -1 +1 +1 +1 +1 

+1 -1 -1 +1 +1 -1 -1 +1 +1 -1 -1 +1 4-1 -1 

+ 1 +1 +1 +1 +1 +1 +1 4l +1 +1 +1 4 1 +1 +1 

+ 1 1.111 1 .1 1 . 1 1 . 1 1 . H 



TABLE n. - TREATMENT PARAMETERS CONFOUNDED 


WITH BLOCK PARAMETERS 


Block effects 

Replicate, a C(i, j) 

Parameter 

Defining 

C(2, 2) 

C( 2,1) 

C(l, 2) 

C(l,l) 


contrast 

Treatment parameters 

** 0 

I 

% 

^I'^ABC 

^I'^ABD 

/3 I‘ /3 ABD' /3 ABC + ^CD 


-ABD 

ABD 

~^ABD + ^CD 




-ABC 

~@ABC 


"^ABC^CD 


Mij 

CD 

&CD 





a Obtained by doubling to level i with respect to the i source of block effects 
and by doubling to level j with respect to the j -source of block effects. 



TABLE HI. - PLAN OF EXPERIMENT 


Block effect 
source 

j 

i 

1 

1 


2 

2 

1 


2 




Vacuum chamber, l 


Loading, k 


Loading number, c 


ae 

adf 


2 

3 

ac 

abd 

abde 

ace 

abf 

aedf 

acdef 

abef 

bd 

c 

ce 

bde 

cdf 

bf 

bef 

edef 

be 

d 

de 

bee 

f 

bedf 

bedef 

ef 

ad 

abc 

abce 

ade 

abedf 

af 

aef 

abedef 


TABLE IV. - DEFINING CONTRASTS 
OF SMALLEST BLOCK C(l, 1, 1, 1) 


Defining contrast 

Block effect source 

I 


A 


-B EF 


-C EF 


D E 


AB EF 

k 

AC EF 


-AD E 


BC 


-BD F 

j 

-CD F 


-ABC 

i 

ABD F 


ACD F 


BCD E 


-ABCD E 

l 



TABLE V. - SELECTION OF TREATMENT GENERATORS 


Treatment 

Independent defining contrasts 

Treatment 

Independent defining contrasts 


-ABC 

-BDF 

ABEF 

-ABCDE 


-ABC 

-BDF 

ABEF 

-ABCDE 

(1) 

0 

0 

0 

0 

f 

0 

1 

1 

0 

a 

1 

0 

1 

1 

af 

1 

1 

2 

1 

b 

1 

1 

1 

1 

bf 

1 

2 

2 

1 

ab 

2 

1 

2 

2 

abf 

2 

2 

3 

2 

c 

1 

0 

0 

1 

cf 

1 

1 

1 

1 

ac 

2 

0 

1 

2 

acf 

2 

1 

2 

2 

be 

2 

1 

1 

2 

bef 

2 

2 

2 

2 

abc 

3 

1 

2 

3 

abef 

3 

2 

3 

3 

d 

0 

1 

0 

1 

df 

0 

2 

1 

1 

ad 

1 

1 

1 

2 

adf 

1 

2 

2 

2 

bd 

1 

2 

1 

2 

bdf 

1 

3 

2 

2 

abd 

2 

2 

2 

3 

abdf 

2 

3 

3 

3 

cd 

1 

1 

0 

2 

cdf 

1 

2 

1 

2 

acd 

2 

1 

1 

3 

aedf 

2 

2 

2 

3 

bed 

2 

2 

1 

3 

bedf 

2 

3 

2 

3 

abed 

3 

2 

2 

4 

abedf 

3 

3 

3 

4 

e 

0 

0 

1 

1 

ef 

0 

1 

2 

1 

ae 

1 

0 

2 

2 

aef 

1 

1 

3 

2 

be 

1 

1 

2 

2 

bef 

1 

2 

3 

2 

abe 

2 

1 

3 

3 

abef 

2 

2 

4 

3 

ce 

1 

0 

1 

2 

cef 

1 

1 

2 

2 

ace 

2 

0 

2 

3 

acef 

2 

1 

3 

3 

bee 

2 

1 

2 

3 

beef 

2 

2 

3 

3 

abce 

3 

1 

3 

4 

abcef 

3 

2 

4 

4 

de 

0 

1 

1 

2 

def 

0 

2 

2 

2 

ade 

1 

1 

2 

3 

adef 

1 

2 

3 

3 

bde 

1 

2 

2 

3 

bdef 

1 

3 

3 

3 

abde 

2 

2 

3 

4 

abdef 

2 

3 

4 

4 

ede 

1 

1 

1 

3 

edef 

1 

2 

2 

3 

aede 

2 

1 

2 

4 

aedef 

2 

2 ' 

3 

4 

bede 

2 

2 

2 ! 

4 

bedef 

2 

3 

3 ! 

4 

abede 

3 

2 

3 ; 

5 

abc def 

3 

3 

4 

5 


TABLE VI. - ASSOCIATION OF TREATMENT AND CONTRAST 


GENERATORS WITH BLOCK EFFECT SOURCES 


Treatment 

Block effect source introduced 

Defining contrast eliminated by 

generator 

with doubling by treatment 

doubling with treatment 

bede 

bef 

generator 

generator 

abed 

i 

-ABC 

ab 

j 

-BDF 

ac 

k 

ABEF 

abd 

l 

-ABCDE 
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Block effects 


TABLE VII. - TREATMENT PARAMETERS CONFOUNDED WITH BLOCK PARAMETERS 
| Fractional replicate, a C(i, j, k, l ) 


Parameter Prior Defining C(l,2,2,2) C{2, 1,2,2) C(2, 2,1,2) C(2, 2,2,1) C(l, 1,2,2) C(l, 2, 1,2) C(l,2,2, 1) C(2,l,l,2) 

probability contrasts 1 ! 

Stopping probability 


Subscripts of treatment parameters 


C(2, 1,2,1) 


ABEF -ABCDE -ABC 
-BDF 


-ABC -BDF 

-ABCDE ABEF 


0.50 -ABC 


0. 50 -BDF 


0.10 ABEF 


BCDE -BEF 


0.20 -ABCDE -ABCDE -ABCDE -ABCDE 
DE ACEF -CDF 


-ABCDE -ABCDE 
DE DE 

ACEF -CDF 


0. 10 -CEF 


0. 10 -ADE -ADE 


0.10 ACEF ACEF 


0.10 -CDF -CDF -CDF 


0. 10 BCDE 


0.10 -BEF 


0. 10 ABDF 


• 0. 10 BC 


ABDF BC 


A CDF ACDF 

BCDE -BEF 


-BEF ABDF 


, l ) is the fractional replicate which, if doubled with respect to i, j, k. or l, contains i, j, k, or l type block effect sources. 
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TABLE Vm. - TREATMENTS AND ESTIMATES FOR 
EXAMPLE OF MISSING BLOCKS 


Treatments 

Estimates 3, 

(a) 

h 

+ 0A 

'^CDF 

_,3 ACDF 

(a)b 

^B 

+ ^AB 

_/3 BCDF 

_/3 abcdf 

(a)(c)d 


+ ^AD 

_/3 cf 

”^ACF 

(a)b(c)d 

%D 

+ ^ABD 

_/3 bcf 

-/3 ABCF 

(a)e 

^E 

+(3 AE 

_|3 cdef 

'^ACDEF 

(a)be 

^BE 

+/3 abe 

■%CDEF 

_/3 ABCDEF 

(a)(c)de 

^DE 

+ @ADE 

’^CEF 

’^ACEF^ rC 

(a)b(c)de 

^BDE 

+ ^ABDE 

"%CEF 

'^ABCEF 

(a)(c)f 

h 

+/3 A F 

_,3 CD 

~@ACD 

(a)b(c)f 

^BF 

+ ^ABF 

_/3 bcd 

'^ABCD 

(a)df 

^DF 

+/3 ADF 


~$AC 

(a)bdf 

^BDF 

+/3 abdf 

'%C 

~Pabc' ,t 

(a)(c)ef 

%F 

+ ^AEF 

_/3 cde 

'^ACDE 

(a)b(c)ef 

^BEF 

+ ^ABEF 

"%CDE 

'^ABCDE^ 

(a)def 

^DEF 

+ ^ADEF 

_(3 ce 

'^ACE 

(a)bdef 

^BDEF 

+/3 ABDEF 

'%CE 

"^ABCE 


a rc denotes estimates confounded with row- column inter- 
action effects; r with row block effects; and c with 
column block effects. 


CO 

C7I 


TABLE IX. - DEFINING CONTRASTS 
WITH MISSING BLOCKS 

[The symbol C(r, c) means the frac- 
tional replicate with row and column 
blocks of table HE as follows: 

C(2, 1) indicates second row, first 
column; C(3, 1) second and third 
rows, first column; C(2, 4) second 
row, first and fourth columns; 

C(3, 4) second and third rows, first 
and fourth columns 3 


Fractional replicate, C(r,c) 


C(2, 1) 

C(3, 1) 

C(2,4) 

C(3, 4) 

Defining contrasts 

I 

I 

I 

I 

A 

A 

A 

A 

BEF 

BEF 



CEF 




-DE 




ABEF 

ABEF 



ACEF 




-ADE 




BC 


BC 


-BDF 


-BDF 


-CDF 

-CDF 

-CDF 

-CDF 

ABC 


ABC 


-ABDF 


-ABDF 


-ACDF 

-ACDF 

-ACDF 

-ACDF 

-BCDE 

-BCDE 



-ABCDE 

-ABCDE 
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